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Abstract — Signal recovery is one of the key techniques of 
Compressive sensing (CS). It reconstructs the original signal 
from the linear sub-Nyquist measurements. Classical methods 
exploit the sparsity in one domain to formulate the LO norm 
optimization. Recent investigation shows that some signals are 
sparse in multiple domains. To further improve the signal 
reconstruction performance, we can exploit this multi-sparsity 
to generate a new convex programming model. The latter 
is formulated with multiple sparsity constraints in multiple 
domains and the linear measurement fitting constraint. It 
improves signal recovery performance by additional a priori 
information. Since some EMG signals exhibit sparsity both 
in time and frequency domains, we take them as example in 
numerical experiments. Results show that the newly proposed 
method achieves better performance for multi-sparse signals. 

I. INTRODUCTION 

Compressive sensing (CS) has attracted considerable at- 
tention in signal processing. It employs nonadaptive linear 
projections that preserve the structure of the signal; the signal 
is then reconstructed from these projections using nonlinear 
methods. Rather than first sampling at a high Nyquist rate 
and then compressing the sampled data, it directly senses 
the data in a compressed form with a lower sampling 
rate. CS provides a new promising framework for acquiring 
signals. Signal recovery, as one of the key techniques of CS, 
reconstructs the original signal from the linear sub-Nyquist 
measurements [1]. 

In classical signal recovery, sparsity is exploited by formu- 
lating an LI -norm optimization problem. Only one sparsity 
constraint is used with a linear measurement fitting constraint 
[2]. But some signals are sparse in more than one domain. 
For example, some electromyography (EMG) signals are 
sparse in both time and frequency domains [3] [4] [5], 
as shown in Fig. [T] some microwave signals are sparse 
in both frequency and space domains [6] [7]. Taking into 
consideration the multi-sparsity, we use multiple LI norm 
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minimization based sparsity constraints to encourage sparse 
disttibution in all the corresponding domains. As more a pri- 
ori information is used, the recovery performance would be 
enhanced. Numerical experiments demonstrate the proposed 
method has a better performance than previous methods. 

0. COSPARSE ANALYSIS SIGNAL MODEL 

Sparsity exists in many signals. It means that many of 
the representation coefficients are close to or equal to zero, 
when the signal is represented in some domain. Traditionally, 
a synthesis representation model decomposes the signal into 
a linear combination of a few columns chosen from a pre- 
defined dictionary (representation mattix). Recently, a new 
signal model, called cosparse analysis model, was proposed 
in [8]. In this new sparse representation, an analysis operator 
multiplying the measurements leads to a sparse outcome. Let 
signal in discrete form be expressed as: 



(1) 



where x € R Nxl is the original signal obtained at Nyquist 
sampling rate; *P e C LxN is the analysis operator; 8 e C 
is the resulting sparse representative vector, i.e. most of the 
elements of 6 are almost zero. Here L > N . In a practical 
CS system, the analogue baseband signal x(t) is sampled 
using an analogue-to-information converter (AIC) [9]. The 
AIC can be conceptually modeled as an analogue-to-digital 
converter (ADC) operating at Nyquist rate, followed by a 
CS operation. Then the random sub-Nyquist measurement 
vector y € R Mxl is obtained directly from the continuous- 
time signal x(t) by AIC. For demonstration convenience, we 
formulate the sampling as: 

y = Ox (2) 

where O € R MxA ' is the measurement matrix; M <k N . Three 
frequently used examples are: Gaussian matrix; Bernoulli 
matrix and partial Fourier matrix. 

III. MULTI-SPARSE SIGNAL RECOVERY 

After obtaining the random samples from AIC, they are 
sent to the digital signal processor (DSP) to get the signal. 
The classical sparse signal recovery model can be formulated 



min||Tx|| 

X 

s .t . y = <Dx 



(3) 



where the L0 norm ||0|| o , counting the number of nonzero 
entries of the vector 8 = [6\, 02, ■ ■ ■ , 8n] t , encourages sparse 
distribution. However, © is NP-hard unfortunately. 



Mainly three groups of algorithms exist to solve (0 [10]. 
The first one is convex programming, such as basis pursuit 
(BP), Dantzig selector (DS); the second one constitutes of 
greedy algorithms, such as matching pursuit (MP), orthogo- 
nal matching pursuit (OMP); the third one includes hybrid 
methods, such as CoSaMP, stage-wise OMP (StOMP). In 
these algorithms, convex programming has the best recon- 
struction accuracy; greedy algorithms have the least com- 
putational complexity; hybrid methods try to balance the 
reconstruction accuracy and computational complexity. 

A. LI optimization 

In order to get the highest recovery accuracy, we choose 
convex programming to do CS. Basis pursuit denoising 
(BPDN) is the most popular one. It can be formulated as 



minllTxIl, 
s. t. ||y - Ox|| 2 < e 



(4) 



where ||0||] = 2m Iftnl is the LI norm of the vector 6 = 
[01, 0i, ■ ■ ■ , On] 7 ', s is a nonnegative scalar bounding the 
amount of noise in the data. 

If the signal is sparse in the time domain, we can choose 
identity matrix as the analysis operator, i.e. V = I. Thus, the 
standard BPDN can be reformulated as: 



mm \\x\\ l 

X 

s. t. ||y - Ox|| 2 < s 



(5) 



Here we call (0 T-Ll optimization. This convex optimization 
model can be reformulated as: 



min l r t 

x,t 

s. t. ||y - <Dx|| 2 < s 
-t<x<t 



(6) 



where 1 is an N-by-1 vector with all elements being 1 . © is 
a semidefinite programming (SDP) problem. It can be solved 
by software, such as SeDuMi [12], cvx [13], etc. 

Similarly if the signal is sparse in the frequency domain, 
we can also recover it by: 



min ||Fx||i 

X 

s. t. ||y - Ox|| 2 < E 



(7) 



where F is the N-by-N Fourier transform matrix. To distin- 
guish from (0, (0 is named F-Ll optimization. It can 
be reformulated as an SDP: 



min l r Ft 

x,t 

s. t. ||y - Ox|| 2 < s 
-t < Fx < t 



(8) 



B. Multi-Ll optimization 



To further enhance the performance of signal reconstruc- 
tion, we can exploit the unique property that some signals 
are sparse in multiple domains. This a priori information 
may be helpful to improve the signal recovery performance. 



Here we propose a new optimization model for multi-sparse 
signal recovery as: 

p 

min 2 (a p ||T p x|| ) 



p=i 
s. t. ||y • 



(9) 



Ox|| 2 < s 



where P is the number of analysis operators which generate 



sparse outcome; A p 



1, 2, 



P, is the parameter 



balancing the different sparsity constraints. Here we call (0 
multi-LO optimization. Since more a priori information is 
used, we expect to achieve better reconstruction performance. 

Transforming the nonconvex multi-LO optimization (0 
into a convex programming one, we get 

■TjSWMIi) do) 

s.t. Hy - Ox|| 2 < e 

We call ( [Tot multi-Ll optimization. It can be rewritten as an 
SDP: 



(11) 



min 2 Apl/tp 

Vl,-,tp \p=l 

s.t.Hy - Ox|| 2 < e 



t, < T,x < t 



-t p < WpX < t p 



C. LI -LI optimization for EMG signal recovery 

EMG aims at recording of the electrical activity pro- 
duced by muscles. It is very useful for detection of various 
pathologies [4]. Long-term EMG monitoring using multiple 
channels usually requires a very large amount of data for 
sampling, transmitting, storage and processing. However, the 
wireless portable recording devices are constrained to have 
low battery power, small size and limited transmitting power 
due to the portability requirement and safety constraints. 
Therefore, real-time data compression is important [11]. 

Some EMG signals are sparse in both time and frequency 
domains, and CS has been introduced to EMG bio-signals 
[5]. But it mainly investigates the effects of the quantization 
of the random coefficients of the measurement matrix. 

Here we apply the multi-Ll optimization to the EMG 
signal recovery, we set P = 2, "P] = I, and *P 2 = F, the 
multi-Ll optimization ( fTOb reduces to: 

mindlxll! +<l 2 ||Fx||i) 

s. t. ||y-Ox|| 2 <e 

where /l 2 is a nonnegative scalar balancing the two LI norm 
minimization based sparsity constraints. Here /l 2 is related 
to the length of signal N. ( fT2] i is called Ll-Ll optimization. 
To solve it, we can reformulate it as: 

min(i r t+A 2 l 7 V) 

x,t,r V ' 

s. t. ||y-Ox|| 2 <e (13) 

-t < X < t 

-r < Fx -< r 

( [TBI is an SDP. It can be solved by convex optimization 
software too [12] [13]. 



(12) 



IV. NUMERICAL EXPERIMENTS 

In the numerical experiments, we use the proposed multi- 
Ll optimization, the LI norm optimization and the relaxed 
least squares (LS) method with min x ||x|| 2 , s. t. ||y - Ox|| < s 
to recovery a group of multi-sparse signals. Then we compare 
the signal recovery performance. 

The multi-sparse signals are chosen to be the EMG signals 
which are obtained from the Physiobank database [14]. In 
[5], the static thresholding algorithm is used to reconstruct 
the EMG signals, whose accuracy is obviously worse than 
convex relaxation. The measurement matrix <t> is formed 
by sampling the i.i.d. entries from a white Gaussian dis- 
tribution. Here four signal recovery methods, Least Squares 
(LS) methods with x = argmin x ||x|| 2 , s. t. ||y - Ox|| 2 , T- 
Ll optimization ©, F-Ll optimization (0, and the newly 
proposed LI -LI optimization ( fT2] >. are used to reconstruct 
the EMG signals. A% is chosen to be 0.05 in order to balance; 
s is chosen to be 5% of the measurement power, i. e. 
b = 0.05||y|| 2 . 

To quantify the performance of signal recovery, the root 
mean squared error (RMSE) is calculated via the formula: 

(14) 

Here x/ is the normalized original EMG signal in the Z-th 
Monte Carlo simulation; x/ is the normalized estimated EMG 
signal in the l-th Monte Carlo simulation; L is the number of 
Monte Carlo simulations. Because the amount of available 
data is limited, L is chosen to be 40. 

Fig. [U Fig. [2] and Fig. [3] show three sections of EMG 
signals of a healthy person (EMG - healthy), a patient with 
myopathy (EMG -myopathy) and a patient with neuropathy 
(EMG - neuropathy), respectively. We can see that all three 
signals are sparse in the time domain. In the frequency 
domain, EMG - healthy and EMG - myopathy signals are 
sparse but the EMG - neuropathy signal is not. 

Fig. |H Fig. [5] and Fig. [6] show the recovery performance 
of the three different EMG signals. Here the length of the 
original EMG signal sections is equal to N - 512. All 
RMSE values decrease with the increase of sub-sampling 
ratio M/N. When the sub-sampling ratio reaches 1, it still can 
not achieve the perfect reconstruction with RMSE = 0, which 
results from the relaxation of the constraint from y = Ox to 
||y - Ox|| 2 < e. It may be the price for robustness. Besides, 
because all the EMG data are noisy, and the noiseless 
signal can not be available in (TBI) , the performance may 
be better than RMSE demonstrates. To present the recovery 
performance more directly, Fig. [7] gives an example of the 
reconstruction of a section of EMG - myopathy signal with 
sub-sampling ratio equals to 0.50. We can see the profile of 
the signal can be well reconstructed. 

In Fig. @1 T-Ll optimization performs better than F-Ll 
optimization; but in Fig. [5] F-Ll optimization is better than 
T-Ll optimization. However, LI -LI optimization is the best 
of all in both Fig. [4] and Fig. [5] In Fig. [6] we can see that Ll- 
Ll optimization is better than F-Ll optimization, but worse 



than T-Ll optimization. The reason is that the EMG signal 
here is not sparse in the frequency domain, which can be 
seen in Fig. [3] 

In summary, if the EMG signal is sparse in both time and 
frequency domains, Ll-Ll optimization is the best candidate 
for compressive EMG signal recovery. Moreover, if the 
signal is likely to be sparse in multiple domains with a certain 
degree of uncertainty, the Ll-Ll optimization is also a robust 
choice, because it can at least avoid the worst performance. 

In addition, when M = 256, the average computing time 
for T-Ll optimization, F-Ll optimization and the Ll-Ll 
optimization is respectively 2.71 16 seconds, 17.2069 seconds 
and 10.3265 seconds. The computing time of Ll-Ll opti- 
mization is longer than T-Ll optimization but shorter than 
F-Ll optimization. 

V. CONCLUSION 

In this paper, we propose a signal recovery method for 
multi-sparse signals. The newly proposed multi-Ll opti- 
mization encourages sparse distribution in multiple domains. 
Since more a priori information is exploited, the signal 
recovery performance would be enhanced. Numerical exper- 
iments take EMG signals as examples to demonstrate the 
performance improvement. 

In the future, we will analyze the theoretical conditions for 
successful recovery by the proposed method. Furthermore, 
we will develop a hybrid method for multi-sparse signal 
recovery to decrease the computation complexity. The Split 
Bregman method will be used to accelerate the solution of 
multi-sparse signal recovery problem. 
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Fig. 4. Signal recovery performance for the data EMG - healthy. 
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Fig. 1 . An example of EMG data from a healthy person: EMG - healthy. 
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Fig. 5. Signal recovery performance for the data EMG - myopathy. 
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Fig. 2. An example of EMG data from a patient with myopathy: EMG- 
myopathy. 
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Fig. 6. Signal recovery performance for the data EMG - neuropathy. 
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Fig. 3. An example of EMG data from a patient with neuropathy: EMG- 
neuropathy. 



Fig. 7. An example of EMG — neuropathy signal recovery with the sub- 
sampling ratio = 0.50. 



